Generalised Exponential Families and Associated Entropy Functions
نویسنده
چکیده
A generalised notion of exponential families is introduced. It is based on the variational principle, borrowed from statistical physics. It is shown that inequivalent generalised entropy functions lead to distinct generalised exponential families. The well-known result that the inequality of Cramér and Rao becomes an equality in the case of an exponential family can be generalised. However, this requires the introduction of escort probabilities.
منابع مشابه
Deformed Algebras and Generalizations of Independence on Deformed Exponential Families
A deformed exponential family is a generalization of exponential families. Since the useful classes of power law tailed distributions are described by the deformed exponential families, they are important objects in the theory of complex systems. Though the deformed exponential families are defined by deformed exponential functions, these functions do not satisfy the law of exponents in general...
متن کاملInformation Theory and Statistical Mechanics Revisited
We derive Bose-Einstein statistics and Fermi-Dirac statistics by Principle of Maximum Entropy applied to two families of entropy functions different from the Boltzmann-Gibbs-Shannon entropy. These entropy functions are identified with special cases of modified Naudts’ φ-entropy. In a pioneering work sixty years ago, Jaynes [4] initiated the study of statistical physics by information theory. He...
متن کاملThe Tsallis Distribution and Generalised Entropy: Prospects for Future Research into Decision-Making under Uncertainty
1. Introduction This paper reviews recent work on the properties of Tsallis distributions, Tsallis statistics, anomalous diffusion and multi-fractal processes. Processes of this kind have the capacity to represent natural phenomena that are associated with turbulence and emerging complexity. However, in addition they may also capture crucial aspects of human decision-making in response to condi...
متن کاملBounds on approximate steepest descent for likelihood maximization in exponential families
An approximate steepest descent strategy converging, in families of regular exponential densities, to maximum likelihood estimates of density functions is described. These density estimates are also obtained by an application of the principle of minimum relative entropy subject to empirical constraints. We prove tight bounds on the increase of the log-likelihood at each iteration of our strateg...
متن کامل0 30 70 65 v 3 2 A pr 2 00 4 Generalised definitions of certain functions and their uses
Generalised definitions of exponential, trigonometric sine and cosine and hyperbolic sine and cosine functions are given. In the lowest order, these functions correspond to ordinary exponential, trigonometric sine etc. Some of the properties of the generalised functions are discussed. Importance of these functions and their possible applications are also considered. PACS No.: 02.30.Hq, 02.30.Gp...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
- Entropy
دوره 10 شماره
صفحات -
تاریخ انتشار 2008